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Introduction 


The New York State Education Department (NYSED) reports unadjusted growth scores that 
include only prior achievement as a predictor variable. NYSED also reports adjusted growth 
scores that control for prior achievement and student characteristics as predictor variables’. 
Unadjusted scores are reported for informational purposes to educators and are used for 
school accountability in Grades 4—8. For school accountability purposes, New York State uses a 
school’s or subgroup’s unweighted two-year average mean growth percentile (MGP) in ELA and 
mathematics. 


This document describes the model used to measure student growth for institutional 
accountability in New York State for the 2015/16 school year. In 2015/16, growth models were 
implemented for institutional accountability in Grades 4-8 ELA and mathematics. All models 
are based on assessing each student’s change in performance between 2014/15 (and prior 
years) and 2015/16 on State assessments compared with students who have similar prior 
performance. Revisions to the State-provided growth model will be considered in future years. 


Content and Organization of This Report 
The results presented in this report are based on 2015/16 and prior school years’ data, with 
some comparison to prior-year results. This technical report contains four main sections: 


1. Data— Description of the data used to implement the student growth model, including 
data processing rules and relevant issues that arose during processing. 

2. Model — Description of the unadjusted statistical model. 

Reporting — Description of reporting metrics. 

4. Results — Overview of key model results aimed at providing information on model 
quality and characteristics. 


a 


Data 


To measure student growth and attribute that growth to schools, at least two sources of data 
are required: student test scores that can be observed across time and information describing 
how students are linked to schools (i.e., identifying which school students attend for a tested 
subject). 


* For information on the growth model used for teacher and principal evaluation, see the 2015/16 technical report. 
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The following sections describe the data used for model estimation in New York in more detail, 
including some of the issues and challenges that arose and how they were handled. 


Test Scores 

New York’s student growth models drew on test score data from statewide testing programs in 
Grades 3-8 in ELA and mathematics for the growth model for schools of students in Grades 4— 
8. In Grades 4-8, institutional growth models are estimated separately by grade and subject 
using scores from each grade (e.g., Grade 5 mathematics) as the outcome. 


State Tests in ELA and Mathematics (Grades 3-8) 

The New York State tests at the elementary and middle school grade levels measure a range of 
knowledge and skills in mathematics and ELA. State tests in ELA and mathematics for Grades 3— 
8 are given in the spring. The 2015/16 school year was the fourth school year that the State 
tests were designed to measure the Common Core State Standards. 


The New York Grades 4-8 institutional growth model uses test scores in each subject area as a 
predictor for that subject area (e.g., mathematics scores are used to predict mathematics 
scores). Specifically, New York’s Grades 4-8 institutional growth model includes three prior test 
scores in the same subject area. If the immediate prior-year test score in the same subject was 
missing from the immediate prior grade, the student was not included in the growth measure 
for that subject. For example, students without a prior-year test score or with a prior-year test 
score for the same grade as the current year test score did not have growth scores computed 
for them. 


For the other prior scores, missing data indicators were used. These missing indicator variables 
allow the model to include students who do not have the maximum possible test history and 
mean that the model results measure outcomes for students with and without the maximum 
possible assessment history. This approach was taken to include as many students as possible. 
For the 2015/16 analyses, data from 2015/16 were used as outcomes, with prior achievement 
predictors coming from the previous 3 years (going back to 2012/13). The specific tests used as 
predictors vary by grade and subject and are as follows and presented visually in Table 1: 


e Grade 4 ELA and mathematics models used scores from Grade 3 in ELA and 
mathematics. Students were NOT included if they lacked Grade 3 scores from the 
immediate prior year in the same subject. 

e Grade 5 ELA and mathematics models used scores from Grades 3 and 4 in ELA and 
mathematics. Students were NOT included if they lacked Grade 4 scores from the 
immediate prior year in the same subject. 

e Grades 6-8 ELA and mathematics models used scores from Grades 3-7 in ELA and 
mathematics. Students were NOT included if they lacked the immediate prior-year score 
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in the same subject (e.g., Grade 6 students must have had a Grade 5 score in the same 
subject from 2014/15). 


Table 1. Prior Year Same Subject Test Scores Included 


Prior Year Same Subject Test Scores Included in the Model 


Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 


cy 
ns 
26 
aE 
> 
o 2 
So 
so 
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In addition to test scores, the New York Grades 4-8 institutional growth model also used the 
conditional standard errors of measurement of those test scores. All assessments contain some 
amount of measurement error, and the New York Grades 4-8 institutional growth model 
accounts for this error (as described in more detail in the Model section of this report). 
Conditional standard errors were obtained from published technical reports for the 
assessments’ prior-year test scores, and the State’s test vendor provided a similar table for the 
2015/16 test scores. 


School Attribution 

For the New York Grades 4-8 institutional growth model, students were attributed to schools 
based on a continuous enrollment indicator. This variable describes whether a student was 
enrolled at the start and end of the year in a school or district (on BEDS day and at the 
beginning of the State test administration in the spring). Students who met this criterion were 
included in school-level MGPs. Unlike teacher attribution, student results were not weighted by 
attendance in determining a school MGP and growth score. The policy rationale for not using 
attendance weighting for schools (although it is used for teachers) is that school leaders may 
have more influence on student attendance, and on the integrity of attendance data, than do 
teachers. Table 3 shows attribution rates for schools. 


Table 2. Grades 4-8 School-Student Attribution Rates 
Valid Student Records Attributed to at Attribution 


Valid Student Records 


Least One School Rate 
4 294,727 286,477 97% 
5 286,405 279,007 97% 
6 272,380 265,611 98% 
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Valid Student Records Attributed to at Attribution 


Valid Student Records 


Least One School Rate 

7 260,571 254,297 98% 

8 220,316 214,643 97% 
Total 1,334,399 1,300,035 97% 


Note. Student records are considered valid for the purposes of growth modeling when there are at least two 
consecutive years of valid assessment scores. Students can have as many as two valid records per year, one for ELA 
and one for mathematics. 


The attribution rate at the school level in 2015/16 (97%) was the same as the value in 2014/15. 
Fewer student records overall were attributed to schools in 2015/16 than in 2014/15. 


Model 


This section describes the statistical model used to measure student growth in New York 
between two points in time on a single subject of a State assessment. The section begins with a 
description of the statistical model used to form the comparison point against which students 
are measured, and follows with a description of how SGPs are derived from the comparison 
point. In addition, this section describes how MGPs and all variance estimates are produced. 


At the core of the New York State institutional growth model is the production of an SGP. This 
statistic characterizes the student’s current year score relative to other students with similar 
prior test score histories. For example, an SGP equal to 75 denotes that the student’s current 
year score is the same as or better than 75% of the students in the State with prior test score 
histories and other measured characteristics that are similar. It does not mean that the 
student’s growth is better than that of 75% of all other students in the population. 


The institutional model implemented for New York State is a linear regression model designed 
to account for measurement variance in the predictor variables, as well as the outcome 
variable, to yield unbiased estimates of the model coefficients. Subsequently, these model 
coefficients are used to form a predicted score, which is ultimately the basis for the SGP. 
Because the prediction is based on the observed score, it is necessary to account for 
measurement variance in the prediction as well. Hence, the model accounts for measurement 
variance in two steps: first in the model estimation and second in forming the prediction. The 
next section describes this model in detail. 


Covariate Adjustment Model 
The statistical model implemented as the MGP model is typically referred to as a covariate 
adjustment model (McCaffrey, Lockwood, Koretz, & Hamilton, 2004), as the current year 
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observed score is conditioned on prior levels of student achievement as well as other possible 
covariates. 


In its most general form, the model can be represented as follows: 


L 
Vi = > Ve-riVt—r + i 
r=1 


where y;; is the observed score at time t for student i, y;_, is the observed lag score at time 
t—r(r€ {1,2,...,L}) and y is the coefficient vector capturing the effects of lagged scores. 


Accounting for Measurement Variance in the Predictor Variables 

All test scores are measured with variance, and the magnitude of the variance varies across the 
range of test scores. The standard errors (square roots of variances) of measurement are 
referred to as conditional standard errors of measurement (CSEMs) because the variance of a 
score is heteroscedastic and depends on the score itself. Figure 1 shows a sample from the 
Grade 8 ELA test in New York. 


Figure 1. Conditional Standard Error of Measurement Plot (Grade 8 ELA, 2015/16) 


Standard Error of Measurement 
2 os 
ry 


to 
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200 300 400 
Scale Score 


Treating the observed scores as if they were the true scores introduces a bias in the regression, 
and this bias cannot be ignored within the context of a high-stakes accountability system 
(Greene, 2003). In test theory, the observed score is described as the sum of a true score plus 
an independent variance component, X = X* + U, where U is a matrix of unobserved 
disturbances with the same dimensions as X. 


Our estimator accounting for the error in the predictor variables is derived in a manner similar to 
that of Goldstein (1995). 
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Specification for MGP Model for Grades 4-8 

The preceding section provides details on the general modeling approach and specifically how 
measurement variance is accounted for in the model. The exact specification for the New York 
Grades 4-8 model in 2015/16 is described as follows: 


K M 
Voi =~ Ut ». BiYg-r.i + ». TsMgj + E; 
l=1 s=1 


where yo; is the current year test scale score for student i in grade g, yu is the intercept, f is 
the set of coefficients associated with the three prior test scores, T, is the set of coefficients 
associated with the missing variable indicators, and ¢€; is the student residual. 


Student Growth Percentiles 

The previously described regression models yield unbiased estimates of the coefficients by 
accounting for the measurement error in the observed scores. The resulting estimates are then 
used to form a student-level SGP statistic. For purposes of the growth model, a predicted value 
and its variance for each student are required to compute the SGPs as follows: 


SGP, = ® Sf ae 4! 


2 
Dyfi 


where SGP, is the observed value of the outcome variable and 9; = w’d where w’ is the ith row 
of the model matrix W, and the notation OF pi is used to mean the variance of the predicted 
value of y for the ith student. 


Here, the regression is of form 
Y=W6é+e 
where 
e~N(0,07) 
For this case, the classic variance of a predictor is 
Ospi = [1+ wi (w'w) tw, J62 


where G2 is the variance of the predictor. However, in this case, we make two refinements to 

acknowledge the effect of measurement error on the residual variance. The first is to use the 

—2 : . 
which is 


actual variance on y,, called Opi, rather than the population variance on y;, called Oyis 


www.nysed.gov Page 9 


New York State Education Department 
2015/16 Growth Model for Institutional Accountability 
Technical Report 


already included in G2. This is done by subtracting the population variance and adding back the 
individual variance. Thus, the variance on the predictor becomes 


OFF i =[1+ wi(w'w) tw] [o2 — a. + Ovi 


The second refinement is to replace the population variance in w;, called 2, with the individual 
variance in w;, called X;. This replacement is done in the same way as with the variance in y;, so 
the variance estimate is now 


Oye = + wi(w'w) wi] [od — a5, — 6’E5] + of; + 6'E;6 


A predicted value for each student is used to compute the SGP. However, that prediction is 
based on the estimates of the fixed effects that were corrected for measurement variance but 
based on the observed score in vector w. 


Figure 2 illustrates how the SGPs are found from the previously described approach. The 
illustration considers only a single predictor variable, although the concept can be generalized 
to multiple predictor variables, as presented earlier. For each student, we find a predicted value 
conditional on his or her observed prior scores and the model coefficients. To illustrate the 
concept, assume we find the prediction and its variance but do not account for the 
measurement variance in the observed scores used to form that prediction. We would form a 
conditional distribution around the predicted value and find the portion of the normal 
distribution that falls below the student’s observed score. This is equivalent to 


SGP; = [-reoax 


with fO)~N(S;, Os fi) although this is readily accomplished using the cumulative normal 
distribution function, ®(-). 
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Figure 2. Sample Growth Percentile from Model 
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Figure 3 illustrates the same hypothetical student shown in Figure 2. Note that the observed 
score and predicted value are identical. However, the prediction variance is larger than in 
Figure 2. As a result, when we integrate over the normal from —oo to y;, the SGP is 60, not 90 
as in the previous example. This difference occurs because the conditional density curve has 
become more spread out, reflecting less precision in the prediction. 
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Figure 3. Sample Growth Percentile from Model 
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Mean Growth Percentiles 

Once SGPs are estimated for each student, group-level (e.g., school-level) statistics can be 
formed that characterize the typical performance of students within a group. New York’s 
growth model Technical Advisory Committee recommended using a mean SGP for educator 
scores. Hence, group-level statistics are expressed as the mean SGP within a group. This statistic 
is referred to as the MGP. 


For each aggregate unit (je{1,2, ..., /}), such as a school, the statistic of interest is a summary 
measure of growth for students within this group. Within group j, there are 
{SGP iy, SGPi2),  SGPicyy}- That is, there is an observed SGP for each student within group j. 


Then the MGP for unit j is produced as 
6; = mean(SGPj1)) 


As with all statistics, the MGP is an estimate, and it has a variance term. The following measures 
of variance are produced for the MGP. 


The analytic standard error of the unweighted MGP for schools is computed within unit j as 
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sd(SGP;; 
se(0;) — Salen) 
WN 
where sd(SGP;;) is the sample standard deviation of the SGPs in group j, and Nj is the number 
of students in group /. 


Combining Student Growth Percentiles Across Grades and Subjects 

Many schools serve students from different grades and with results from different tested 
subjects. For evaluation purposes, there is a need to aggregate these SGPs and form a summary 
measure, in this case, mean growth percentiles (MGPs). 


Because the SGPs are expressed as percentiles, they are free from scale-specific inferences and 
can be combined. For any aggregate-level statistics to be provided (MGPs), all SGPs of relevant 
students are pooled and the mean of the pooled SGPs is found. 


Reporting 


The main reporting metrics for schools of Grades 4-8 were as follows: 


e Number of Student Scores — The number of SGPs included in an MGP. 

e Unadjusted MGP — The mean of the SGPs for students attributed to the school based on 
similar prior achievement scores only, without taking into consideration ELL, disability, 
economic disadvantage, or other student characteristics. 

e Lower Limit and Upper Limit — Highest and lowest possible MGP for a 95% confidence 
range. 


MGPs disaggregated by grade and subject also are provided. Districts also are provided with 
student roster files. These files show which students were included in a school’s MGP along 
with information about each student, such as whether the student has a disability or is 
identified as an ELL. 


Minimum sample size requirements for reporting MGPs and growth ratings were determined to 
balance statistical reliability and availability of school growth scores. On one hand, setting no 
(or alow) minimum sample size will result in the greatest number of schools receiving 
information; on the other hand, the quality of the information they receive may be reduced. A 
minimum threshold of 16 student scores was implemented. Scores on any measure at any level 
based on fewer than 16 student scores were not reported. 


After applying this rule, the fraction of schools with reported results is shown in Table 3 for 
Grades 4-8. The percentages of schools receiving results in 2015/16 were unchanged relative to 
the 2014/15 percentages. 
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Table 3. Grades 4-8 Reporting Rates 
Number of Schools Meeting the Percentage of Schools Meeting the 
Minimum Sample Size Minimum Sample Size 
Requirement Requirement 


3,745 3,583 96% 


Number of Schools with at Least 


One Student Attributed 


For schools of Grades 4-8, the overall MGP (i.e., the MGP that combines information across all 
applicable grade levels and subjects outlined in the previous section) and upper and lower limit 
MGPs were used to determine growth ratings. 


Results 


This section provides an overview of the results of the 2015/16 growth model estimation. Some 
comparisons to earlier year growth model results are also included. A pseudo R-squared 
statistic and summary statistics characterizing the SGPs, MGPs, and their precision provide an 
overview of model fit. 


Model Fit Statistics for Grades 4-8 

The R-square value is a statistic commonly used to describe the goodness-of-fit for a regression 
model. Because the model implemented here is an EiV model, not a least squares regression, 
we refer to this as a pseudo R-square. Table 9 presents the pseudo R-square values for each 
grade and subject, computed as the squared correlation between the fitted values and the 
outcome variable. 


Table 4. Grades 4—8 Unadjusted Model Pseudo R-Squared Values by Grade and Subject 


Grade ELA Mathematics 
4 0.64 0.69 
5 0.70 0.74 
6 0.70 0.72 
7 0.73 0.74 
8 0.71 0.67 


Student Growth Percentiles for Grades 4—8 

SGPs describe a student’s current year score relative to those of other students in the data with 
similar prior academic histories and other measured characteristics. A student’s SGP should not 
be expected to be higher or lower based on his or her prior-year score. Table 5 shows the 
correlation between the prior-year scale score and SGP for each grade and subject. These 
correlations are usually negative as a result of using the EiV approach to account for 
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measurement variance in the prior-year scale score; the correlation need not be zero. Squaring 
these values gives the percentage of variation in SGPs explained by prior-year scores for any 
grade and subject. Although prior-year test scores are generally good predictors of current year 
test scores, the prior-year test score is a poor predictor of current year SGPs. As shown in Table 
5, prior-year test scores explain about 2% to 3% of the variation in SGPs. Because SGPs are 
intended to allow students to show low or high growth no matter their prior performance, this 
result is as expected. 


Table 5. Grades 4—8 Unadjusted Model Correlation Between SGP and Prior-Year Scale Score 


Grade ELA Mathematics 
4 -0.155 -0.125 
5 -0.140 -0.164 
6 -0.120 -0.144 
7 -0.139 -0.180 
8 -0.130 -0.175 


Reliability of Unadjusted MGPs 
It is useful to examine the reliability statistic to assess the precision of the school-level MGPs, 


specified here as p: 
= 2 
=  — 
° (satay) 


where oa is the mean standard error of the MGP, and sd(6;) is the standard deviation between 
school MGPs. In theory, the highest possible value is one, which would represent complete 
precision in the measure. When the ratio is zero, the variation in MGPs is explained entirely by 
sampling variation. Larger values of p are associated with more precisely measured MGPs. 


Table 6.provides the mean standard errors, the standard deviations, and the values of p for the 
unadjusted model for schools. 


Table 6. Grades 4—8 Unadjusted Model Mean Standard Errors, Standard Deviation, and Value of 
p by Grade for Schools 


vrdhueg Mean UredstedSandard petty Static () 
4 2.81 9.04 0.903 
5 2.86 8.75 0.893 
6 2.72 9.46 0.918 
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Unadjusted Mean Unadjusted Standard aes ane 
Standard Error Deviation Reliabllity statistic (2) 
7 2.61 8.43 0.904 
8 2.83 8.21 0.881 


Table 7 provides the share of schools whose MGPs are significantly above or below the State 
mean, using the 95% confidence intervals. In all cases, the percentage exceeding the mean is 
larger than what would be expected by chance alone, indicating the model distinguishes 
between schools (2.5% of schools would be expected to be above or below the mean by chance 
alone). 


Table 7. Grades 4—8 Unadjusted Model School MGPs Above or Below the Mean at a 95% 
Confidence Level 


Below Mean Above Mean 


4 698 29.4% 581 24.5% 
5 691 30.1% 562 24.4% 
6 476 28.7% 477 28.7% 
7 435 29.9% 371 25.5% 
8 441 30.8% 306 21.4% 


Neutrality of Unadjusted MGPs 

Given that a primary claim for the use of MGPs in institutional accountability is that all schools 
can demonstrate growth, regardless of the academic starting point of students, it is necessary 
to determine if there is a strong relationship between MGPs and average prior achievement for 
students in a school. To that end, These correlations illustrate that the MGPs are substantially 
neutral to prior achievement. 


Table 8 shows the correlations between MGPs and average prior achievement, with low to 
moderate correlations across all grades and subjects. These correlations illustrate that the 
MGPs are substantially neutral to prior achievement. 


Table 8. Correlation Between Unadjusted Overall MGP and Average Prior Achievement Across 
Grades and Subjects 


Measure of Prior Achievement Correlation Between Unadjusted Overall MGP and Prior Achievement 
Grade 4 ELA 0.177 
Grade 4 Math 0.152 
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Measure of Prior Achievement Correlation Between Unadjusted Overall MGP and Prior Achievement 
Grade 5 ELA 0.021 
Grade 5 Math -0.022 
Grade 6 ELA -0.017 
Grade 6 Math -0.013 
Grade 7 ELA 0.015 
Grade 7 Math -0.019 
Grade 8 ELA 0.051 
Grade 8 Math 0.042 
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Appendix A. Model Coefficients 


The tables that follow display regression model coefficients (labeled as “Effects”) for the New 
York growth model in each grade and subject. For the Grades 4—8 model, these model 
coefficients represent the predicted change in current year test scores for one unit of change in 
each variable shown in the table, holding other variables constant. For example, in Table 9, the 
predicted change in a student’s current year ELA test score given a one point increase ina 
student’s prior grade ELA test score is 0.794. The interpretation of a one-unit change varies by 
variable type. For yes/no variables, model coefficients represent the predicted change in 
current year test scores given a change from no to yes. Missing flags are yes/no variables set to 
yes if the noted variable is missing and no otherwise. 


Because of the differences in model and variable types, it is important to keep in mind that 
effect sizes cannot be compared directly across different types of variables. 


Table 9. Grade 4 ELA Unadjusted Model Coefficients 


Effect Name Effect Standard Error p-value 


Constant Term 69.720 0.497 0.000 


Prior-Grade ELA Scale Score 0.794 0.002 0.000 


Table 10. Grade 5 ELA Unadjusted Model Coefficients 


Effect Name Effect Standard Error p-value 


Constant Term 3.339 0.542 0.000 
Prior-Grade ELA Scale Score 0.707 0.004 0.000 
Two-Grades-Prior ELA Scale Score 0.280 0.004 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 82.155 1.312 0.000 


Table 11. Grade 6 ELA Unadjusted Model Coefficients 


Effect Name Effect Standard Error p-value 
Constant Term 26.484 0.539 0.000 
Prior-Grade ELA Scale Score 0.634 0.004 0.000 
Two-Grades-Prior ELA Scale Score 0.186 0.005 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 53.781 1.473 0.000 
Three-Grades-Prior ELA Scale Score 0.097 0.004 0.000 
Missing Flag: Three-Grades-Prior ELA Scale Score 30.569 1.276 0.000 
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Table 12. Grade 7 ELA Unadjusted Model Coefficients 


Effect Name Effect Standard Error p-value 
Constant Term 32.351 0.494 0.000 
Prior-Grade ELA Scale Score 0.637 0.004 0.000 
Two-Grades-Prior ELA Scale Score 0.185 0.005 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 52.671 1.380 0.000 
Three-Grades-Prior ELA Scale Score 0.084 0.004 0.000 
Missing Flag: Three-Grades-Prior ELA Scale Score 25.787 1.221 0.000 
Table 13. Grade 8 ELA Unadjusted Model Coefficients 
Effect Name Effect Standard Error p-value 
Constant Term 37.647 0.523 0.000 
Prior-Grade ELA Scale Score 0.606 0.004 0.000 
Two-Grades-Prior ELA Scale Score 0.202 0.005 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 57.377 1.415 0.000 
Three-Grades-Prior ELA Scale Score 0.095 0.004 0.000 
Missing Flag: Three-Grades-Prior ELA Scale Score 28.463 1.199 0.000 
Table 14. Grade 4 Mathematics Unadjusted Model Coefficients 
Effect Name Effect Standard Error p-value 
Constant Term 1.078 0.552 0.051 
Prior-Grade ELA Scale Score 0.996 0.002 0.000 
Table 15. Grade 5 Mathematics Unadjusted Model Coefficients 
Effect Name Effect Standard Error p-value 
Constant Term 13.620 0.518 0.000 
Prior-Grade ELA Scale Score 0.734 0.004 0.000 
Two-Grades-Prior ELA Scale Score 0.229 0.004 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 71.301 1.229 0.000 
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Table 16. Grade 6 Mathematics Unadjusted Model Coefficients 


Effect Name Effect Standard Error p-value 
Constant Term -9.395 0.620 0.000 
Prior-Grade ELA Scale Score 0.684 0.005 0.000 
Two-Grades-Prior ELA Scale Score 0.190 0.005 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 57.335 1.557 0.000 
Three-Grades-Prior ELA Scale Score 0.151 0.005 0.000 
Missing Flag: Three-Grades-Prior ELA Scale Score 46.137 1.417 0.000 


Table 17. Grade 7 Mathematics Unadjusted Model Coefficients 


Effect Name Effect Standard Error p-value 
Constant Term 2.806 0.567 0.000 
Prior-Grade ELA Scale Score 0.757 0.004 0.000 
Two-Grades-Prior ELA Scale Score 0.137 0.005 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 43.203 1.411 0.000 
Three-Grades-Prior ELA Scale Score 0.097 0.004 0.000 
Missing Flag: Three-Grades-Prior ELA Scale Score 29.289 1.263 0.000 


Table 18. Grade 8 Mathematics Unadjusted Model Coefficients 


Effect Name Effect Standard Error p-value 
Constant Term -24.308 0.816 0.000 
Prior-Grade ELA Scale Score 0.715 0.006 0.000 
Two-Grades-Prior ELA Scale Score 0.277 0.007 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 83.342 1.976 0.000 
Three-Grades-Prior ELA Scale Score 0.077 0.006 0.000 
Missing Flag: Three-Grades-Prior ELA Scale Score 23.358 1.592 0.000 
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